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ABSTRACT 

In April 1971 the Ontario Educational Communications 
Authority evaluated its simulation game "Operation Moonvigil" ^ an 
action and reflection process for students in grades five through 
nine, designed to allow them to discover how and why institutions 
come into being and interact with individuals. . Questionnaires were 
distributed, student reports of -the game were collected, and 
observers watched classroom activities. The majority of the teachers 
felt "Operation Moonvigil" was successful, that they would use it 
again, and that they would recommend it to other teachers. . Nearly 80% 
of the students favored it. Pre-game teacher worJcshops, accessory 
materials, and teacher involvement activities were seen as useful. 
Knowledge ^gained from the evaluation was felt to be helpful to the 
future modification of gaming experiences, particularly in the area 
of aiding teachers and students to adapt to the new modes of 
teachej?- student interaction which gaming requires. (PB) 
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INn'RODUCTION 

In April 1971 The Research and Development Branch of The Ontario 
Educational Coninunlcatlons Authority undertook a project Intended 
to study one of OECA*s experimental programmes, the simulation 
game entitled "Operation MDonvlgll". 

The project was carried out in two phases. A preliminary evalua- 
tion took p lice in May and Jime in order to test the design ele- 
ments of the sinrulatlpn and effect certain necessary changes. A 
more extcnisive assessment of the programme , based on a much wider - 
sample of user response took place at the time of its first broad- 
cast in Noveoiber. _ 

This paper seeks to review some of the major findings of the two 
evaluations. 

First y a brief Took at simulation games in general, and an intro- 
duction to "Operation Mbonvlgll". 

Simulation 

The simulation game is a simplified-operational model of real-life 
situations. Recognition and formal ln^lementatXon of the simula- 
tion game in its present format as a formal learning tool began 
^ about a decade ago. However, the function of games in socialization 



had occupied social thinkers as early as Herbert Spencer* 



I 



More recently there has occurred a gradual process of recognition 
of the potential learning function of games: 



"... from the 5-nitlal recognition of their 
inherent attractiveness, and their ability to 
captiure Interest and commitinent ; to recognl*- 
t ion of the way in which favourite games mirror 
their surrounding environment or society; to 
recognition of the way in tAich certain types 
of games are particularly appropriate at 
ticular stages in children's development."^ 



Operation 
Moonvigil 



Jo 
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"Operation Moony igil" is a simulation game designed by The Ontario 
Educational Coaanmicatlons-Au^^ It is a three week action v 

and ref lection process for 1^^ It Isr 

designed "to^ allow studehts^ tb id^^^ 

come into beingv to see seine elements involved In th^ Ihteractlpn 

----- -- -- (2) 

between individuals and Institutions"^ . . 

The elements of Moowlgli ccmsist 0f et^t flve-^inute television 
programmes, an Emergency Procedures Kit ciwposed of various support 
materials, and a Teacher's Guide. 



The -setting of the simulation is the Copernicus Crater on the moon, 
the time is ten years hence. The crew of a lunar research vehicle 
is unable to leave the moon due to a serlouls malfunction on board 
the spacecraft. While waiting for rescue the crei^; must provide for 



I 



(^^ Slmulatloh Games fa I^arnlngv S^S . Boocock and 
E.O. Schild (e^s.) S^ge Publications Inc. Calif. 
1968. Pg. 61. 



(2): 



Teacher ^s Guide Operation Moonvlg 1 1. QECA, 1971 pg.l 



I: 



1 



1 1 



if] 

If! 



I H 



10 

In 



- -Si 



their basic survival, communicate with Mission Contni, and main- 
tain their health and morale. , ~ 

These basic survival tasks constitute the rationale for the divis- 
ion of the crew into three groi5)S. The Blue-Survival Group is 
mainly responsible for food rationing. The Red -Coomunicat ions 
Groiq> is responsible for receiving, decoding and sending messages 
tp^and from Mission Control. Bie Orange - Health and Morale Group 
is responsible for health, and morale-building activities and the 
hospitalization procedures. 

Each day, via television, the crew receives its survival^directions 
from Mission Control. The broadcast Is preceded by five minutes of 
preparatory activity, followed by a half hour of task completion. 

An emergency Prpcedtures Klt^^^ for > 

xJSily task-K:oBf)letibn. i . v. 

Each Moon Day is designed to present the crew with a new challenge, 
and new experiences in Institution building. 

For instance, in preparation for rescue, the crew must conduct a 
Flight Simulation Exercise. Radioactivity contaminates some of the 
food siq>plie8 sending certain members into a hospital. Participants 
are asked to undertake and master another's job. These constitute 
some of the game's dramatic elements. 

The chief personalities involved in Moonvigil art-: the crew of 
scientists on the moon (the students), the teacher as the Debriefing 
Officer, and, via television, the earth broadcast personnel - Mission 
Control, Loopie - the coo5>uter coanand consul, the Sky lab crew, and 
the news announcers. " - 
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Procedures 
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THE PRELIMINARY EVALUATION 

In W^y 1971, production oh "Operation Moonvigir' had been coiiq>leted 
an*l the prototype Kit and Teacher's Guide were designed. It was 
important to learn i^icther these simulation coiq>onents worked in 
the classroom in the intended fashion* 

Three volimteesr classrbans partTlcijiated i^^^ 

^ion ; two f r om"Torontp and one from St . Catharines . Two observers 
were present in each- sWopl . 
The observers; inclined m^er^ 



Eindings. 



^i^e^^QHjwgBg^l^S^ 

M^toe^ T^ffe^^^org^^^^^ ^ 
^ drewfifesei^tj^MSS 

^^fighlgaB([^jEhfegame;p C^^ 
^l=lect^ y] 
iStf^ t(M;tXng^U% 

^^raltgtiyStv 

j^nts ^f^5^e^i®ft^^^ t^:^ ^ v - 

The.-f iiidings^^^^^^^ aM ishahgfe a xie- 

sult^ t*^-^y.^igesg 



1) the setting and the players ' identity 

2) the broadcasts 

3) the group procedures 

4) the teacher's role. 

It became apparent, from the testing, that the original brief scen- 
ario introducing "Operation Moonvigil" to the students was insuffic 
ient to establish the setting and the Identity of the players. It 
was decided to introduce a variety of pre-involvement activities to 
precede the actual gaming activities, and to set the scene of the 
crash-landing via the first television broadcast. 

It was learned that certain directions conveyed to the crew via tele- 
vision were unsuccessful in achieving the intended results with the 
students, e.g., group division procedures, and the Fli^t Navigation 
Exercise, ^propria te changes were effected in the broadcasts. 

The testing sessions pointed out some difficulties experienced by 
the players in following the game's instructions, e.g. decoding pro- 
cedures; The student interviews showed that the players would have 
liked more tasks to perform during the game. Both these observa- 
tions were taken into account in refining the instructional materials 
'in the Emergency Procedures Kit. 

In accordance with the teachers* stated opinion, adjustments were 
made in the Teacher's Guide. A more detailed account of daily broad- 
cast content and gaming procedtires came to be included in the Guide, 
as well as some helpful instructions intended to aid the teachers in 
their observations. 
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The recognition of the import^mce of the teacher's rcl^ to the suc- 
cess of the slsmlation led to t^e consideration of the most appropri- 
ate methods for instructing the teachers in the use of "Operation 
Moonvigil". 

It was decided that regional workshops would be conducted in order to 
acquaint the interested teachers with simulation techniques « 



THE EVALUATION AT THE TIME OF THE FIRST BROADC^^ ^T 

"Operation Moonvigil" had its first air date on November I5th. It 
was broadcast three times a day over OECA*s Channel 19 and the pro- 
vincial network of the CBC» 

In October the Research and Development Branch engaged an independent 
Consultant, f)r. A,E* Virgin, of Research and Evaluation Services, to 
report to the Authority on the use of the simulation in the schools 
of Ontario during its first telecast. 

The report has now been submitted to the OECA. It runs well over 200 
pages in leng The procedures used and the major findings are sum- 

marized below. 

Procedures 

First, a description of the instruments developed and samples selected 
to gather data« 

A Teacher Questionnaire comprised of 50 items was designed for the 
evaluation. The questions were both open and closed*ended . Informa* 
tion was sought in some of the following areas: Opinion of OECA work- 
shop, opinion of Moonvigil materials, the nature of the pre-lavolve* 
ment, debriefing and reflection activities, ratings of success of the 
game for each Moon Day, ratings of pupil involvement during the game, 
teacher's role, future use of Moonvigil. 



(3) A limited number of copies are available upon request. 



This questionnaire was sent to 90%<''*>o£ the teachers vho r.ad placed orders 
for the Moonvigil Kit with OECA's Publications Section by November lO^^) ^he 
number of questionnaires sent out was 239. The report analyses 80 or 30% of 
those which were returned by a designated date. A follow-up letter sent by 
The Research and Development Branch which met- with a 52% response rate from 
the entire sample, indicated that 14% of the teachers would return the 
questionnaires shortly. (The roost quoted reason was that the programme was 
videotaped to be viewed several days later) 23% of the responding 
teachers indicated that they would be participating in the simulation during 
the second broadcast date scheduled for mid-January. 

Pupil Questionnaire consisted of 13 items, the majority of which were 
open-ended. Among other things, pupils were asked to indicate their likes 
and dislikes of Moonvigil; why they thought Mission Control created three 
groups; what they would do if they found themselves in a comparable situation 
on a deserted island and what they thought they were supposed to learn from 
playing Moonvigil. 

Six pupil questionnaires were sent out along with each Teacher Questionnaire 
to the sample described above. The teacher was asked to select six pupils, 
one from each Red, Blue, and Orange group of each of the two crews to complete 
these questionnaires. A total of 1296 questionnaires were distributed; 229 
of the 480 returns form the basis of the analysis. 



(4) Some ord^cs were made in bulk by the School Boards atad it was virtually 
Impossible to identify 100% of the participating teachers in time for this 
evaluation. 

(5) Many of the participating teachers were identified for us by the Regional 
Learning Materials Consultants of the Dept. of Education. We thank them 
for their co-operation. 



(6) Tb date of fche writing of this paper the return rate has reached 50%. 
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The Pupil Diaries were completed by a different and smaller sample of pupils. 
These diaries were blank, unstructured booklets. The children were asked to 
write as much as they wanted in their diaries after the completion of each 
Moon Day. They were asked to express their feelings and ideas about Moonvigil, 
and to illustrate these in pictures if they so wished. They were asked to speak 
frankly, as if talking to a friend, and ' , the diaries private. 

Ten sets of 6 diaries were sent out to a regionally distributed sample of schools, 
a part of the above sample of 239 classropms. Thirteen sets of 6 diaries were 
distributed in the observed schools described below. Of the 138 diaries ^dis- 
tributed, 114 or 83% formed the basis for analysis. 

The Observers' Daily Record , Daily observation schedules were developed to cover 
the gaming debriefing and reflection activities of Operation Moonvigil. Each 
schedule contained a brief summary of events for each day and a list of activities 
to watch for during the 45 minute period of observation. Activities typically 
included in these reports were descriptions of ■ the teacher's role, any evidence 
of the game being modified, evidence as to the children's enjoyment and involvement 
in the game. The observation records for each Jay were individually submitted to 
OECA by each observer. More detailed reports were prepared by vill observers at 
the conclusion of the game. 

"thirteen schools were selected from the Metro Toronto region and agreed to the 
presence of an observer during the simulation activities. The selected classrooms 
represented various grade levels, inner-city and suburban, separate and public 
schools. The 13 non-participant observers were selected by- the Consultant from 
among 70 eligible applicants. They were given a training session which included the 
theory of perception and its application to systematic observation, review of Moon- 
vigil and the role of the observer, and an examination of the observers' daily record 
forms . 



Findings The major findings of the study conducted during the November broad- 

cast of "Operation Moonvigil" are presented below. 

Responses to the Teachers' Questionnaire show that the simulation was 
conducted primarily in grades 5 to 8 with grades 6 (22.5%) and 8 (20%) 
predominating. Grade 9 accounts for 3.8% of users and grade 10 for 
1.3%. 

The majority of thje teachers who chose to participate in Moonvigil 
described themselves as "moderately progressive" - 46%, and moderately 
traditional-20%. "Very progressive" accounted for 7% of the answers, 
"uniquely different" for 3%, and, 4% gave no answer. 

It is of interest to note that for almost half of the teachers 45%, 
watching Moonvigil was one of the very few times that they had used 
television in their classrooms. 

Although over half of the teachers 55% indicated chat they had par- 
ticipated as a player in a simulation game, the majority lild never 
conducted a simulation game in their classrooms prior to playing 
Moonvigil. It should also be ncted that 53.7% of the teachers attended 
a workshop sponsored by OECA and participation in a simulation game was 

part of the workshop activities. 
1 

Teachera offered a variety of reasons for their decision to use .- 
Moonvigil with their class. The largest category representing 28.8% 
of the responses indicated the wish to introduce their pupils to a new 
way of teaching. Curiosity and experimentation accounted for 16,3% of 
the reasons, the same number made the decision upon the request of a 
Principal or a Superintendent. 



Fifty four percent of the teachers who returned quesr lonn^-ires had 
attended a workshop sponsored by OECA« Of those who attended a 
workshop, 70% indicated very strongly that the workshop helped to give 
them confidence for using Moonvigil, and 60% indicated that they felt 
the workshop increased their competence in using the simulation. 

The most helpful features of the workshops seemed to be the increased 
familiarization with the programme materials and the game, and the 
acquired ability to understand the students' roles and feelings* Most 
comments related the workshops* least helpful features focused on the 
instructions regarding debriefing. 

The Emergency Procedures Kit and its materials found strong support 

among 777a of the respondents* Sixteen percent, indicated that they 

felt the game was too juvenile or the instructions or contents were poor. 

The most common pre-involvement activities employed by the teacher con- 
sisted of class discussions, and the making and gathering of materials, 
with the latter activities representing the greatest involvement on the 
part o£ the students. 

When asked "Now that you have played the game, what might you have done, 
but did not, in the preparation stages which would have facilitated 
playing the game?" The most cited response was - "played a similar 
simulation game and involved the class in role playing activities*" 

Teachers were asked to indicate in terms of the objectives given in 
the Teacher's Guide, the degree of success of the class in pre- involve- 
ment activities with reasons for their rating* 



RATING OF PREINV0LVEi4ENl'(^) 



Very 



SuccessfuT 



Complete 
Failure 



No 

Answer 



Number 



28. 



25 



15 



0 



4 



Percent 



35% 



31% 



19% 



10% 



Forty-nine gave reasons for the above ratings. Tv;enty-five noted that 
the success was due to high interest on the part of the children, while 
eight teachers stated that they received their kits late and hence their 
pre -involvement activities were not successful • 

The Teachers' Guide contained statements of objectives to be achieved 
for each Moon Day of "Operation Moonvigil". Teachers were asked to 
indica.e the degree of success achieved each day on the basis of these 
objectives. The following ratings emerged. 



(7) Table reproduced from An Evaluation of "Operation Moonvigil" pre- 
pared by Dr. A. E. Virgin, for r.he Research and Development Branch 
of the Ontario Educational Communications Authority, January 1972, 
page 117. 
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RATINGS OF THE SEVEN MOON DAYS 





Very 

Successful 








Complete 
Failure 


No 


Moon Day 1 


16 


20% 


28 


35% 


21 


26% 


10 


13% 


0 




5 

6% 


2 


27 


34% 


22 


28% 


25 


31% 


1 




0 




5 

6% 


3 


15 


, 19% 


38 


48% 


17 


21% 


5 


6% 


0 




5 

' 6% 




15 


19% 


24 


30% 


18 


23% 


15 


19% 


3 


4% 


5 

6% 


5 


24 


30% 


18 


23% 


20 


25% 


10 


13% 


4 


5% 


4 

5% 


6 


12 


15% 


25 


31% 


24 


30% 


8 


10% 


3 


4% 


8 

10% 


7 


11 


14% 


24 


30% 


17 


?1% 


16 


20% 


14 


18% 


8 

10% 



On a group basis, the degree of success was relatively high during the 
first three days, followed by three days of moderate success. The 
seventh day, however, left much to be desired, in that 30 of the 80 
teachers selected "complete failure" or the adjacent ra'ing to des- 
cribe the success on that day, while 35 selected "very successful" or 
the adjacent category for that day. 



(8) ibid. p. 118 
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In elaborating upon these ratings teachers explained that their 
decision was based on the degree of either interest and involve- 
ment or boredom demonstrated by their students, as well as the 
latters' ability to conduct activities and follow instructions 
of the simulation, 

A similar type of rating was requested of the teachers for the 
debriefing and reflection activities. The teachers were asked 
to determine ratings on the basis of the objectives stated in 
the Teachers' Guide. 



RATING OF DEBRIEFING AND REFLEGTION^^^ 

Very - Complete No 

Successful Failure Answe - 



Debriefing 




26% 


27 


" 34% 


16 


20% 


4 

5% 


0 


12 


15% 


Reflection 


8 


10% 


21 

1 ■ , 


26% 


13 


16% 


9 


11% 


1 


1% 


28(*) 


35% 



Likewise a rating of the degree of the students involvement during 
debriefing was requested. 



RATING OF PUPIL INVOLVEMENT DURING DEBRIEFING 





Very 
iHvolved 






Not at all 
Involved 


No 

Answer 


Number 


19 


32 . 


21 


5 1 0 


3 


Percent 


23.8% 


40 .0% 


26.3% 


6.2% 1 


3.8% 



(9) ibid p. 122 

(*) These teachers were still carrying activities at the time 
of response. 

(10) ibid p. 122 



Slightly more than 50% of the respondants indicated they in- 
tended to have three or more reflection days* 

In response to what was done to date during reflection and what 
future projects might be expected, the majority of the teachers 
offered responses in the area of "discussions and concepts" - 18%, 
and 'Siiscussion of specific institutions"l6%* 

In response to the question "What kinds of conclusions did the class 
come to during debriefing and reflection sessions',' the following 
patterns emerged • 



GENERALIZATIONS AND CONCLUSIONS REACHED BY THE CLASS^^^^ 



Response / 


Number and Percent 
Making Comment 


Need for organization during playing 

of game/need for co-operation 

Need for institutions in society 

Didn't see need for groups 

Game was silly, childish 

Other 

No Answer 


26 32.2% 
20 . 24.8% 

3 3.7% 
2 2.5% 

4 4.9% 
.26 32.2% 




81 (*) 



(11) ibid p. 125 

(*) more than one response 
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A large majority ol classes who had reached the reflection stage 
did discuss the concept of institutions. 



CONCEPT OF INSTITUTIONS DISCUSSED 

Not dis- 



(12) 



Yes 



No 



No 

Answer 



, Number' 


35 


8 


5 


8 


i 

1 i 23 


Percent 


43.8% 


10.07, 


6.2% 


10.0% 


1.3% i 28.8% 

i 
1 

. 1 



80 



And the following numbers identified other institutions. 

OTHER INSTITUTIONS IDENTIFIED AND DISCUSSED ^^^^ 





Yes 


No 


No Answer 


Number 


36 


9 


35 


Percent 


45% 


11.3% 


43.8% 











80 



Seventy two percent of the teachers felt that their pupils had achieved 
the objectives of "Operation Moonvigil" contained in the Teachers' 
Guide . 

ACHIEVEMENT OP OBJECTIVES FOR "OPERATION HWNVIGIL" ^^^^ 

■ Yes 





Yes 


No 


and No 


No Answer 


Number 


58 


11 


4 


7 


Percent 


72.5% 


13.7% 


5.0% 


8.8% 



80 



Of the eleven who felt their students did not achieve the objectives, 
four felt It was due to confusion over the institutions, and five 
felt it could be attributed to low ability on the part of their 
students. 



(12) Ibid p. 127 

(13) Ibid p. 127 

(14) Ibid p. 130 



Sixty percent of the respondents felt that the time and effort 
of the pupils spent in playing "Operation Moonvigil" was worth- 
while. 



WHETHER THE TIME AND EFFORT OF PUPILS WAS W^THWHILE 
Yes Ifo So-So Other Answer 



Number 


48 


10 


7 


13 


2 


Percent 


60.07, 


12.5% 


8.8% 


16 ,3% 


2.5% 

1 ■ 



(15) 
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A number of teachers indicated that they had gained new insights 
about their pupils as a result of their observations during the 
game. And 36*6% of the respondents indicated that they had 
gained insight into the class leadership roles. New information 
was learned about^ pupils in 17.17o of the cases and earlier opinions 
held by the teachers were confirmed in 7.3% of the cases. 

With respect to their own role, 39 of the 80 responding teachers 
indicated that they found their role as observer difficult or 
very difficult; 26 felt that it was easy or very easy. T^^enty 
seven of the 38 attributed their difficulties to not being able to 
intervene during the game. 

Twenty one of the 80 te£ichers felt that there was a need to 
modify the game, and eight of the fourteen who elaborated on this 
point made specific suggestions with regard to clarification of 
game instructions* ^ 



(15) ibid. p. 131 
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With respect to the future use of "Operation Moonvigil", 71.3% 
of the teachers would use it with another class; 96% would 
recommend it to other teachers . 



MOONVIGIL CONSIDERED FOR USE WITH ANOTHER CLASS 



(16) 





Yes 


No 


Qualified 
Yes 


No 
Answer 




Number 


57 


4 


18 


1 

1 


80 


Percent 


71.3% 


5.0% 


22.5% 


1.3% 





MOONVIGIL RECOMMENDED TO OTHER TEACHERS 



(17) 





Yes 


No 


No Answer 


Number 


77 


2 


1 


Percent 


96.0% 


2.5% 


1.3% 



80 



Pupils' opinion with respect .to likes and dislikes of the game 
were requested. The following categories of response emerged. 



(16) ibid p. 136 

(17) ibid p. 136 
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REASONS WHY PUPILS LIKED THE GAME 



Response 


Number and Percent 
Making Conunent 


Fun-exciting/ interesting/good experience, etc . 
Informative - learn about Moon/ survival, etc. 
Learned to v7ork in groups, liked groups, etc,/ 
Co-operate 

Realistic - like pretending, etc. 

Liked following instructions /having things 

to do/ jobs 

Food - good 

Change - ''it was different" - Not School 
Learned about organization/society, etc* 
Learned about friends - gained insight, etc. 
Liked TV, Loopie, Mission Control 
Didn't like 
Other 


90 337o 
32 127o 

30 li7o 
26 9% 

22 8% 
21 8% 
19 77o 
9 3% 

7 - 27o 

3 n 

1 2% 
10 , 4% 




276 


(19) 

REASONS WHY PUPILS DISLIKED THE GAME 




Number and Percent 
Making Comment 


No Cooperation 

Boring; not enough to do 

Food sticks 

Not enough time 

Didn't learn much 

Didn't have any dislikes 

Other 

No answer 


46 ' 20% 
35 15% 
9 4% 
8 3% 
3 1% 
24 10% 
31 13% 
75 32% 




231 



(18) ibid p. 157 

(19) ibid p. 159 



In response to the question "What do you think the people who 
made Moonvigil wanted you to learn?" The children answered as 
follows. 



WHAT PUPILS THOUGHT MOONVIGIL INTENDED .TO TEACH 



(20) 



Response 



Number and Percent 
Making Coniment 



Co-operation/work together 

About the moon 

How it feels to be stranded 

Responsibility - self discipline 

Follow instruction, listen 

About organizations 

Learn - ourselves/others 

Other 

No answer 



89 


31% 


52 


18% 


44 


15% 


27 


10% 


24 


8% 


14 


5% 


7 


■ 2% 


21 


7% 


7 


2% 



285 (*) 



The pupils were asked to indicate how much they liked playing the game. 
Seventy nine percent checked the category "very much" or"quite a lot"; 
2.5% said "not too much" or "not at all".- 



PUPIL ENJOYMENT 



(21) 





Very 


Quite 


Alright/ 


Not too 


Not at 




Much 


■ a lot 


OK 


much 


all 


Number 


119 


63 


41 


1 


5 


Percent 


52%^ 


27% 


18% 


.5% 


2% 



15 



(20) ibid p. 160 

(*) More than one response coded for some pupils 
(21-)^ ibid p. 162 



The observations carried on in thirteen Metropolitan Toronto class- 
rooms pointed more specifically to some of the difficulties encoun- 
tered in playing the game« 

It has been noted earlier in this paper that almost half of the res- 
ponding teachers felt that the role the game demanded of them pre-* 
sented con.<5*derable difficulties. 

The demands of that role were given a great variety of intexrpreta- 
tions in the thirteen observed classrooms, ranging from a case where 
the teacher periodically left the room and failed to turn on the TV 
set, to a case where a teacher introduced a new and unintended oper^ 
ating rule into the game« 

The majority of teachers stepped out of their observer roles occasion- 
ally to intervene during the gaming activities* A third of the teach- 
ers remained totally withdrawn* *'It is interesting to note that none 
of the teachers who maintained this (latter) attitude consistently, 
even while remaining in the classrooms, were able to carry on meaning- 
ful debriefing". (^2) 

The observers report that five out of the ten teachers carrying on re- 
flection displayed little ability to assist the pupils' understanding 
during the discussions* Three teachers were able to do so with sue-* 
cess, and two with moderate success* 

The time devoted by the teacher to debriefing and reflection activities 
varied from school to school* Of the original 13 classes, only 5 com- 
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pleted Reflection Day i, On^- dropped out on Itoon Day 5 and others 
[ during debriefing. 

I TKe classroom observations provided a further insight into some 

of the difficulties the children experienced wi*:h the game instruc- 
1 tlons. On Moon Day 1, three classes asked their teacher for as- 

j slstance In division Intc groups, Hov/ever^ teachers in five class- 

rooms felt that such assistance was necessary and provided It. 

^ The Space Navigation Exercise continued to be a problem to the 

[ children, with only three out of the thirteen classrooms performing 

it correctly. 

^ Hospitalization presented another challenge. Nine of the classrooms 

I carried out this procedure with some variations of the original in- 

structions. Four classrooms performed it according to their manuals, 
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Conclusions 



The evaluation points out that "Operation Moonvigil'' had gained a * 
great deal of acceptability among its users at the time of the first 
broadcast. 

To recapitulate, 71»3% of the teachers indicated that they would use 
the simulation with another class, and 96% would recoirmend it to their 
colleagues. Seventy-two percent of the teachers felt that Moonvigil 
had achieved its objectives with the class as presented in the Teacher *s 
Guide; 13.7?i felt to the contrary • 

Those students \Aio liked the simulation "very much" or "quite a lot" 
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constituted 79% of the users. Those who did not like it "too much" 
or "at all" represented 2.5% of the pupils. 

In assessing "Operation Moonvigil" as a learning system, the study 
asked the participating teachers for the ratings of efferiiveness 
of all the components of the simulation: the workshops, the 
accessory materials, the preinvolvement, garaing, debriefing and 
reflection activities. 

The workshops were given a very high rating by 70% of the users 
in term of confidence gained, and by 60% in terms of competence 
gained . - 

The Emergency Procedures Kit and the Teachers' Guide received higii 
support from 77% of the teachers. 

Preinvolvement activities were considered very successful by 35-^, 
and successful by 31%. Teachers were able to suggest alternative 
strategies in cases where they felt that the activities failed to 
achieve the intended objectives. 

Individual ratings for each Moon Day showed that the activities of 
the first three days were successful, the next three moderately so, 
and the seventh day was unsatisfactory. This situation prompted 
some teachers to suggest that the simulation be shortened by one 
or two days. 
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The debriefing and reflection days oresentod a varied picture. The 
majority of those teachers who carried on these activities felt that 
they had achieved the desired objectives. However, there is reason to 
believe on the basis of the observers' reports and the questionnaire 
returns that a large number of teachers experienced considerable dif- 
ficulties and often curtailed activities prematurely. (Teachers 
asked that debriefing and reflection be dealt with more extensively 
in the workshops). 

There is no doubt that a simulation game such^s^ ''Operation Moonvigil" 
calls for great adjustments in the traditional teacher -pupil mode of 
classroom interaction. The difficulties experienced by both teachers 
and pupils in adapting to these new roles present the most formidable 
challenge to the stsccess of the simulation. 

Dr. Virgin describes these concerns in the conclusion to his study: 

They (teachers) felt the children needed to develop 
television listening and reading for action skills. 
Secondly, and to an even greater degree, increased 
group interaction skills are required. Many of the 
pupils expressed a lack of co-operative effort in 
groups as a major dislike in playing the game, thus 
substantiating the teacher's concerns. 

According to the observer and the teachers' self- 
report, teachers had difficulty following the pres- 
cribed role as outlined in the Teacher's Guide. Some 
intervened to clarify instructions, so that the child- 
ren would be able to accoin)lish their tasks. Ho^^ever, 
in a significant .number of schools, it appears that 
intervention became interference while in other class- 
rooms where the role was interpreted to be so strictly 
passive, the pupils became frustrated. Teachers play- 
ing Moonvigil must become sensitive as to when to in- 
tervene and when to allow the pupiX92tQ solve the dif- 
ficulties on their own initiative. ^ 
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In order to overcome these obstacles, the study niakes ttl.e following 
recommendations • 

1) More time and emphasis should be accorded to 
classroom -preinvolvement activities prior to 
to the game in order to allow children to 
acquire some of the necessary skills to parti- 
cipate in the simulation. 

2) The teachers' workshop should be modified to 
include a) a detailed study and discussion of 
the Teachers' Guide, b) suggestions and mate- 
rials for specific preinvolvement activities, 
and c) experience which teachers can use to 
assist pupils to conceptualize. 

3) The workshop should be mandatory so that 
teachers will be fully aware of the demands 
of the game and will take steps to avoid 
conflicting activities during MDonvigil* 



